Weather Profiling

Dataset statistics

Number of variables	21
Number of observations	203973
Missing cells	1410888
Missing cells (%)	32.9%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	32.7 MiB
Average record size in memory	168.0 B

Variable types

NUM	14
CAT	6
DATE	1

Warnings

`wind_spd` has a high cardinality: 2186 distinct values	High cardinality
`pct_possible` has a high cardinality: 102 distinct values	High cardinality
`wind_chill` is highly correlated with `temp`	High correlation
`temp` is highly correlated with `wind_chill`	High correlation
`sta_press` is highly correlated with `sea_lvl_press` and 1 other fields	High correlation
`sea_lvl_press` is highly correlated with `sta_press` and 1 other fields	High correlation
`altimeter_setting` is highly correlated with `sea_lvl_press` and 1 other fields	High correlation
`file_name` is highly correlated with `site` and 1 other fields	High correlation
`site` is highly correlated with `file_name`	High correlation
`year` is highly correlated with `file_name`	High correlation
`dew_pt` has 31293 (15.3%) missing values	Missing
`rH` has 31361 (15.4%) missing values	Missing
`heat_idx` has 200433 (98.3%) missing values	Missing
`wind_chill` has 132253 (64.8%) missing values	Missing
`wind_dir` has 10967 (5.4%) missing values	Missing
`hr_precip` has 152903 (75.0%) missing values	Missing
`snow_depth` has 75498 (37.0%) missing values	Missing
`snowfall_3hr` has 76765 (37.6%) missing values	Missing
`snowfall_6hr` has 77147 (37.8%) missing values	Missing
`snowfall_24hr` has 77582 (38.0%) missing values	Missing
`sea_lvl_press` has 129512 (63.5%) missing values	Missing
`sta_press` has 104548 (51.3%) missing values	Missing
`altimeter_setting` has 104548 (51.3%) missing values	Missing
`solar_radiation` has 103039 (50.5%) missing values	Missing
`pct_possible` has 103039 (50.5%) missing values	Missing
`hr_precip` is highly skewed (γ1 = 77.15931459)	Skewed
`snowfall_3hr` is highly skewed (γ1 = 42.5850237)	Skewed
`snowfall_6hr` is highly skewed (γ1 = 38.03277476)	Skewed
`snowfall_24hr` is highly skewed (γ1 = 23.63135992)	Skewed
`hr_precip` has 45920 (22.5%) zeros	Zeros
`snow_depth` has 10522 (5.2%) zeros	Zeros
`snowfall_3hr` has 83847 (41.1%) zeros	Zeros
`snowfall_6hr` has 81761 (40.1%) zeros	Zeros
`snowfall_24hr` has 78076 (38.3%) zeros	Zeros
`solar_radiation` has 51952 (25.5%) zeros	Zeros

Reproduction

Analysis started	2023-01-11 15:47:06.542181
Analysis finished	2023-01-11 15:47:42.416190
Duration	35.87 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

dt
Date

Distinct	79353
Distinct (%)	38.9%
Missing	0
Missing (%)	0.0%
Memory size	1.6 MiB

Minimum	2007-01-01 00:00:00
Maximum	2022-12-31 16:00:00

Histogram

Histogram with fixed size bins (bins=50)

temp
Real number (ℝ)

HIGH CORRELATION

Distinct	152
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	36.59389723
Minimum	-49
Maximum	106
Zeros	592
Zeros (%)	0.3%
Memory size	1.6 MiB

Quantile statistics

Minimum	-49
5-th percentile	7
Q1	23
median	34
Q3	50
95-th percentile	72
Maximum	106
Range	155
Interquartile range (IQR)	27

Descriptive statistics

Standard deviation	20.00827821
Coefficient of variation (CV)	0.5467654369
Kurtosis	0.04882038782
Mean	36.59389723
Median Absolute Deviation (MAD)	13
Skewness	0.1567569316
Sum	7464167
Variance	400.3311968
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
32	5595	2.7%
30	5151	2.5%
31	5086	2.5%
28	5047	2.5%
27	4957	2.4%
29	4892	2.4%
33	4856	2.4%
26	4703	2.3%
25	4439	2.2%
24	4268	2.1%
Other values (142)	154979	76.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-49	1	< 0.1%
-48	2	< 0.1%
-47	1	< 0.1%
-45	1	< 0.1%
-44	1	< 0.1%

Value	Count	Frequency (%)
106	1	< 0.1%
104	2	< 0.1%
102	1	< 0.1%
101	2	< 0.1%
100	5	< 0.1%

dew_pt
Real number (ℝ)

MISSING

Distinct	153
Distinct (%)	0.1%
Missing	31293
Missing (%)	15.3%
Infinite	0
Infinite (%)	0.0%

Mean	26.25127982
Minimum	-76
Maximum	101
Zeros	582
Zeros (%)	0.3%
Memory size	1.6 MiB

Quantile statistics

Minimum	-76
5-th percentile	1
Q1	18
median	27
Q3	37
95-th percentile	49
Maximum	101
Range	177
Interquartile range (IQR)	19

Descriptive statistics

Standard deviation	15.47150367
Coefficient of variation (CV)	0.5893618815
Kurtosis	3.316775538
Mean	26.25127982
Median Absolute Deviation (MAD)	9
Skewness	-0.9906090565
Sum	4533071
Variance	239.3674258
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
26	5392	2.6%
28	5131	2.5%
24	5130	2.5%
30	5107	2.5%
25	5074	2.5%
32	4952	2.4%
23	4835	2.4%
20	4677	2.3%
22	4654	2.3%
21	4621	2.3%
Other values (143)	123107	60.4%
(Missing)	31293	15.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-76	2	< 0.1%
-75	2	< 0.1%
-74	4	< 0.1%
-73	4	< 0.1%
-72	11	< 0.1%

Value	Count	Frequency (%)
101	1	< 0.1%
75	1	< 0.1%
74	5	< 0.1%
73	6	< 0.1%
72	6	< 0.1%

rH
Real number (ℝ_≥0)

MISSING

Distinct	100
Distinct (%)	0.1%
Missing	31361
Missing (%)	15.4%
Infinite	0
Infinite (%)	0.0%

Mean	72.71190879
Minimum	1
Maximum	100
Zeros	0
Zeros (%)	0.0%
Memory size	1.6 MiB

Quantile statistics

Minimum	1
5-th percentile	29
Q1	55
median	80
Q3	92
95-th percentile	99
Maximum	100
Range	99
Interquartile range (IQR)	37

Descriptive statistics

Standard deviation	23.10823166
Coefficient of variation (CV)	0.317805323
Kurtosis	-0.5249556732
Mean	72.71190879
Median Absolute Deviation (MAD)	15
Skewness	-0.7488090353
Sum	12550948
Variance	533.9903703
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	7118	3.5%
94	6113	3.0%
92	5921	2.9%
96	5830	2.9%
95	5681	2.8%
93	5440	2.7%
90	5007	2.5%
91	4838	2.4%
97	4722	2.3%
98	4118	2.0%
Other values (90)	117824	57.8%
(Missing)	31361	15.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	163	0.1%
2	225	0.1%
3	183	0.1%
4	107	0.1%
5	51	< 0.1%

Value	Count	Frequency (%)
100	7118	3.5%
99	3389	1.7%
98	4118	2.0%
97	4722	2.3%
96	5830	2.9%

heat_idx
Real number (ℝ_≥0)

MISSING

Distinct	29
Distinct (%)	0.8%
Missing	200433
Missing (%)	98.3%
Infinite	0
Infinite (%)	0.0%

Mean	82.53700565
Minimum	78
Maximum	201
Zeros	0
Zeros (%)	0.0%
Memory size	1.6 MiB

Quantile statistics

Minimum	78
5-th percentile	79
Q1	80
median	82
Q3	84
95-th percentile	89
Maximum	201
Range	123
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	3.965097524
Coefficient of variation (CV)	0.04804023957
Kurtosis	227.5681745
Mean	82.53700565
Median Absolute Deviation (MAD)	2
Skewness	8.743039208
Sum	292181
Variance	15.72199838
Monotocity	Not monotonic

Histogram with fixed size bins (bins=29)

Value	Count	Frequency (%)
80	732	0.4%
81	564	0.3%
82	432	0.2%
79	416	0.2%
83	316	0.2%
84	256	0.1%
85	203	0.1%
86	168	0.1%
87	113	0.1%
88	103	0.1%
Other values (19)	237	0.1%
(Missing)	200433	98.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
78	43	< 0.1%
79	416	0.2%
80	732	0.4%
81	564	0.3%
82	432	0.2%

Value	Count	Frequency (%)
201	1	< 0.1%
110	1	< 0.1%
107	1	< 0.1%
104	4	< 0.1%
102	2	< 0.1%

wind_chill
Real number (ℝ)

HIGH CORRELATION
MISSING

Distinct	112
Distinct (%)	0.2%
Missing	132253
Missing (%)	64.8%
Infinite	0
Infinite (%)	0.0%

Mean	15.35204964
Minimum	-70
Maximum	42
Zeros	798
Zeros (%)	0.4%
Memory size	1.6 MiB

Quantile statistics

Minimum	-70
5-th percentile	-14
Q1	8
median	17
Q3	26
95-th percentile	37
Maximum	42
Range	112
Interquartile range (IQR)	18

Descriptive statistics

Standard deviation	15.94270288
Coefficient of variation (CV)	1.038473901
Kurtosis	2.301358773
Mean	15.35204964
Median Absolute Deviation (MAD)	9
Skewness	-1.173803657
Sum	1101049
Variance	254.1697751
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
16	2544	1.2%
19	2479	1.2%
18	2335	1.1%
21	2270	1.1%
22	2254	1.1%
14	2229	1.1%
24	2107	1.0%
11	2009	1.0%
10	2007	1.0%
13	1929	0.9%
Other values (102)	49557	24.3%
(Missing)	132253	64.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-70	4	< 0.1%
-69	4	< 0.1%
-68	4	< 0.1%
-67	3	< 0.1%
-66	2	< 0.1%

Value	Count	Frequency (%)
42	163	0.1%
41	479	0.2%
40	442	0.2%
39	1112	0.5%
38	1029	0.5%

wind_dir
Categorical

MISSING

Distinct	16
Distinct (%)	< 0.1%
Missing	10967
Missing (%)	5.4%
Memory size	1.6 MiB

WSW	36888
SW	34848
SSW	19673
NW	17057
WNW	13352
Other values (11)	71188

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
WSW	36888	18.1%
SW	34848	17.1%
SSW	19673	9.6%
NW	17057	8.4%
WNW	13352	6.5%
W	12620	6.2%
S	8676	4.3%
NE	7518	3.7%
NNE	7349	3.6%
NNW	7046	3.5%
Other values (6)	27979	13.7%
(Missing)	10967	5.4%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	3
Median length	3
Mean length	2.359964309
Min length	1

wind_spd
Categorical

HIGH CARDINALITY

Distinct	2186
Distinct (%)	1.1%
Missing	0
Missing (%)	0.0%
Memory size	1.6 MiB

0G0	5369
1G4	5353
1G3	4677
1G5	3633
2G6	3500
Other values (2181)	181441

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
0G0	5369	2.6%
1G4	5353	2.6%
1G3	4677	2.3%
1G5	3633	1.8%
2G6	3500	1.7%
2G7	3434	1.7%
2G5	3203	1.6%
0G2	3195	1.6%
2G8	2850	1.4%
3G8	2669	1.3%
Other values (2176)	166090	81.4%

Frequencies of value counts

Unique

Unique	693 ?
Unique (%)	0.3%

Histogram of lengths of the category

Length

Max length	6
Median length	4
Mean length	3.929485765
Min length	1

hr_precip
Real number (ℝ_≥0)

MISSING
SKEWED
ZEROS

Distinct	50
Distinct (%)	0.1%
Missing	152903
Missing (%)	75.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.005847464265
Minimum	0
Maximum	19.58
Zeros	45920
Zeros (%)	22.5%
Memory size	1.6 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0.02
Maximum	19.58
Range	19.58
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.1995774027
Coefficient of variation (CV)	34.13058955
Kurtosis	6392.244838
Mean	0.005847464265
Median Absolute Deviation (MAD)	0
Skewness	77.15931459
Sum	298.63
Variance	0.03983113967
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	45920	22.5%
0.01	2342	1.1%
0.02	980	0.5%
0.03	531	0.3%
0.04	377	0.2%
0.05	255	0.1%
0.06	190	0.1%
0.07	105	0.1%
0.08	82	< 0.1%
0.09	68	< 0.1%
Other values (40)	220	0.1%
(Missing)	152903	75.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	45920	22.5%
0.01	2342	1.1%
0.02	980	0.5%
0.03	531	0.3%
0.04	377	0.2%

Value	Count	Frequency (%)
19.58	1	< 0.1%
17.75	1	< 0.1%
17.53	1	< 0.1%
16.48	1	< 0.1%
15.64	1	< 0.1%

snow_depth
Real number (ℝ_≥0)

MISSING
ZEROS

Distinct	1178
Distinct (%)	0.9%
Missing	75498
Missing (%)	37.0%
Infinite	0
Infinite (%)	0.0%

Mean	24.66734306
Minimum	0
Maximum	495.5
Zeros	10522
Zeros (%)	5.2%
Memory size	1.6 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	4.4
median	12.8
Q3	38.6
95-th percentile	77.9
Maximum	495.5
Range	495.5
Interquartile range (IQR)	34.2

Descriptive statistics

Standard deviation	26.87865895
Coefficient of variation (CV)	1.089645483
Kurtosis	5.692131014
Mean	24.66734306
Median Absolute Deviation (MAD)	11.5
Skewness	1.5359546
Sum	3169136.9
Variance	722.462307
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	10522	5.2%
0.1	1248	0.6%
0.3	1059	0.5%
0.2	881	0.4%
0.4	678	0.3%
2.5	670	0.3%
4.3	588	0.3%
4	579	0.3%
4.4	561	0.3%
4.2	557	0.3%
Other values (1168)	111132	54.5%
(Missing)	75498	37.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	10522	5.2%
0.1	1248	0.6%
0.2	881	0.4%
0.3	1059	0.5%
0.4	678	0.3%

Value	Count	Frequency (%)
495.5	1	< 0.1%
479.6	1	< 0.1%
452	1	< 0.1%
443.7	1	< 0.1%
424.3	1	< 0.1%

snowfall_3hr
Real number (ℝ_≥0)

MISSING
SKEWED
ZEROS

Distinct	389
Distinct (%)	0.3%
Missing	76765
Missing (%)	37.6%
Infinite	0
Infinite (%)	0.0%

Mean	0.4944610402
Minimum	0
Maximum	407.4
Zeros	83847
Zeros (%)	41.1%
Memory size	1.6 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.2
95-th percentile	1.9
Maximum	407.4
Range	407.4
Interquartile range (IQR)	0.2

Descriptive statistics

Standard deviation	4.743690728
Coefficient of variation (CV)	9.593659242
Kurtosis	2543.494672
Mean	0.4944610402
Median Absolute Deviation (MAD)	0
Skewness	42.5850237
Sum	62899.4
Variance	22.50260172
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	83847	41.1%
0.1	8035	3.9%
0.2	5529	2.7%
0.3	4002	2.0%
0.4	3286	1.6%
0.5	2523	1.2%
0.6	2090	1.0%
0.7	1827	0.9%
0.8	1626	0.8%
0.9	1266	0.6%
Other values (379)	13177	6.5%
(Missing)	76765	37.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	83847	41.1%
0.1	8035	3.9%
0.2	5529	2.7%
0.3	4002	2.0%
0.4	3286	1.6%

Value	Count	Frequency (%)
407.4	1	< 0.1%
401.6	1	< 0.1%
398.5	1	< 0.1%
383	1	< 0.1%
379.2	1	< 0.1%

snowfall_6hr
Real number (ℝ_≥0)

MISSING
SKEWED
ZEROS

Distinct	433
Distinct (%)	0.3%
Missing	77147
Missing (%)	37.8%
Infinite	0
Infinite (%)	0.0%

Mean	0.6838818539
Minimum	0
Maximum	495.5
Zeros	81761
Zeros (%)	40.1%
Memory size	1.6 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.3
95-th percentile	2.6
Maximum	495.5
Range	495.5
Interquartile range (IQR)	0.3

Descriptive statistics

Standard deviation	6.255344767
Coefficient of variation (CV)	9.146820802
Kurtosis	1986.370717
Mean	0.6838818539
Median Absolute Deviation (MAD)	0
Skewness	38.03277476
Sum	86734
Variance	39.12933815
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	81761	40.1%
0.1	6391	3.1%
0.2	4720	2.3%
0.3	3584	1.8%
0.4	3050	1.5%
0.5	2407	1.2%
0.6	2162	1.1%
0.7	1861	0.9%
0.8	1708	0.8%
0.9	1418	0.7%
Other values (423)	17764	8.7%
(Missing)	77147	37.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	81761	40.1%
0.1	6391	3.1%
0.2	4720	2.3%
0.3	3584	1.8%
0.4	3050	1.5%

Value	Count	Frequency (%)
495.5	1	< 0.1%
479.6	1	< 0.1%
424.3	1	< 0.1%
410.6	1	< 0.1%
399.8	1	< 0.1%

snowfall_24hr
Real number (ℝ_≥0)

MISSING
SKEWED
ZEROS

Distinct	451
Distinct (%)	0.4%
Missing	77582
Missing (%)	38.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.132665301
Minimum	0
Maximum	487.1
Zeros	78076
Zeros (%)	38.3%
Memory size	1.6 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.7
95-th percentile	4.5
Maximum	487.1
Range	487.1
Interquartile range (IQR)	0.7

Descriptive statistics

Standard deviation	7.181039728
Coefficient of variation (CV)	6.339948549
Kurtosis	816.2880054
Mean	1.132665301
Median Absolute Deviation (MAD)	0
Skewness	23.63135992
Sum	143158.7
Variance	51.56733158
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	78076	38.3%
0.1	3817	1.9%
0.2	3302	1.6%
0.3	2857	1.4%
0.4	2594	1.3%
0.5	2085	1.0%
0.6	1903	0.9%
0.7	1778	0.9%
0.8	1686	0.8%
0.9	1369	0.7%
Other values (441)	26924	13.2%
(Missing)	77582	38.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	78076	38.3%
0.1	3817	1.9%
0.2	3302	1.6%
0.3	2857	1.4%
0.4	2594	1.3%

Value	Count	Frequency (%)
487.1	1	< 0.1%
443.3	1	< 0.1%
418.3	1	< 0.1%
393.4	1	< 0.1%
382.9	1	< 0.1%

site
Categorical

HIGH CORRELATION

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.6 MiB

SNSLP	75498
JVEMT	26167
S11MT	26048
MRPMT	25744
SH7MT	25612

Frequencies
Length

Value	Count	Frequency (%)
SNSLP	75498	37.0%
JVEMT	26167	12.8%
S11MT	26048	12.8%
MRPMT	25744	12.6%
SH7MT	25612	12.6%
SH4MT	24904	12.2%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	5
Median length	5
Mean length	5
Min length	5

file_name
Categorical

HIGH CORRELATION

Distinct	34
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.6 MiB

SNSLP-2016.html	8764
JVEMT-2020.html	8724
S11MT-2020.html	8710
SNSLP-2017.html	8558
MRPMT-2020.html	8362
Other values (29)	160855

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
SNSLP-2016.html	8764	4.3%
JVEMT-2020.html	8724	4.3%
S11MT-2020.html	8710	4.3%
SNSLP-2017.html	8558	4.2%
MRPMT-2020.html	8362	4.1%
SH7MT-2020.html	8324	4.1%
SH7MT-2022.html	8321	4.1%
MRPMT-2022.html	8320	4.1%
JVEMT-2022.html	8314	4.1%
S11MT-2022.html	8230	4.0%
Other values (24)	119346	58.5%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	15
Median length	15
Mean length	15
Min length	15

year
Categorical

HIGH CORRELATION

Distinct	14
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.6 MiB

2020	49692
2022	48814
2021	42086
2019	16560
2016	8764
Other values (9)	38057

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
2020	49692	24.4%
2022	48814	23.9%
2021	42086	20.6%
2019	16560	8.1%
2016	8764	4.3%
2017	8558	4.2%
2018	7139	3.5%
2008	6214	3.0%
2007	5591	2.7%
2014	3536	1.7%
Other values (4)	7019	3.4%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	4
Median length	4
Mean length	4
Min length	4

sea_lvl_press
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	13939
Distinct (%)	18.7%
Missing	129512
Missing (%)	63.5%
Infinite	0
Infinite (%)	0.0%

Mean	969.3133442
Minimum	21
Maximum	1193.98
Zeros	0
Zeros (%)	0.0%
Memory size	1.6 MiB

Quantile statistics

Minimum	21
5-th percentile	775.44
Q1	968.93
median	1012.43
Q3	1023.76
95-th percentile	1078.14
Maximum	1193.98
Range	1172.98
Interquartile range (IQR)	54.83

Descriptive statistics

Standard deviation	103.3706377
Coefficient of variation (CV)	0.1066431596
Kurtosis	0.05560112754
Mean	969.3133442
Median Absolute Deviation (MAD)	14.75
Skewness	-1.148955857
Sum	72176040.92
Variance	10685.48873
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1015.46	97	< 0.1%
1015.12	80	< 0.1%
1011.92	73	< 0.1%
1015.8	70	< 0.1%
1019	67	< 0.1%
1016	67	< 0.1%
1017.48	65	< 0.1%
1018.16	65	< 0.1%
1012.26	62	< 0.1%
1017.89	61	< 0.1%
Other values (13929)	73754	36.2%
(Missing)	129512	63.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
21	1	< 0.1%
50.49	1	< 0.1%
70.08	1	< 0.1%
137.38	1	< 0.1%
156.67	1	< 0.1%

Value	Count	Frequency (%)
1193.98	1	< 0.1%
1185.13	1	< 0.1%
1183.74	1	< 0.1%
1182.99	1	< 0.1%
1177.37	1	< 0.1%

sta_press
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	537
Distinct (%)	0.5%
Missing	104548
Missing (%)	51.3%
Infinite	0
Infinite (%)	0.0%

Mean	22.68769666
Minimum	0
Maximum	25.71
Zeros	2
Zeros (%)	< 0.1%
Memory size	1.6 MiB

Quantile statistics

Minimum	0
5-th percentile	17.79
Q1	22.9
median	23.2
Q3	24.53
95-th percentile	24.88
Maximum	25.71
Range	25.71
Interquartile range (IQR)	1.63

Descriptive statistics

Standard deviation	2.347370415
Coefficient of variation (CV)	0.1034644658
Kurtosis	0.4917023691
Mean	22.68769666
Median Absolute Deviation (MAD)	1.12
Skewness	-1.326638013
Sum	2255724.24
Variance	5.510147864
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
23.17	1761	0.9%
23.14	1725	0.8%
23.1	1496	0.7%
23.2	1487	0.7%
23.07	1476	0.7%
23.27	1410	0.7%
23.24	1394	0.7%
23.04	1350	0.7%
23.31	1186	0.6%
17.89	1152	0.6%
Other values (527)	84988	41.7%
(Missing)	104548	51.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2	< 0.1%
17.37	3	< 0.1%
17.38	1	< 0.1%
17.39	2	< 0.1%
17.4	5	< 0.1%

Value	Count	Frequency (%)
25.71	1	< 0.1%
25.7	2	< 0.1%
25.67	2	< 0.1%
25.66	1	< 0.1%
25.57	1	< 0.1%

altimeter_setting
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	691
Distinct (%)	0.7%
Missing	104548
Missing (%)	51.3%
Infinite	0
Infinite (%)	0.0%

Mean	28.88638672
Minimum	0
Maximum	33.35
Zeros	2
Zeros (%)	< 0.1%
Memory size	1.6 MiB

Quantile statistics

Minimum	0
5-th percentile	23.07
Q1	29.66
median	29.96
Q3	30.15
95-th percentile	31.47
Maximum	33.35
Range	33.35
Interquartile range (IQR)	0.49

Descriptive statistics

Standard deviation	2.690465918
Coefficient of variation (CV)	0.09313957968
Kurtosis	0.974998366
Mean	28.88638672
Median Absolute Deviation (MAD)	0.22
Skewness	-1.557833259
Sum	2872029
Variance	7.238606856
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
30.02	1503	0.7%
30.06	1476	0.7%
30.04	1475	0.7%
30.03	1447	0.7%
29.99	1421	0.7%
30.01	1395	0.7%
30.05	1362	0.7%
30	1338	0.7%
30.08	1327	0.7%
29.97	1317	0.6%
Other values (681)	85364	41.9%
(Missing)	104548	51.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2	< 0.1%
22.53	3	< 0.1%
22.55	1	< 0.1%
22.56	2	< 0.1%
22.57	5	< 0.1%

Value	Count	Frequency (%)
33.35	1	< 0.1%
33.33	2	< 0.1%
33.3	2	< 0.1%
33.29	1	< 0.1%
33.17	1	< 0.1%

solar_radiation
Real number (ℝ_≥0)

MISSING
ZEROS

Distinct	990
Distinct (%)	1.0%
Missing	103039
Missing (%)	50.5%
Infinite	0
Infinite (%)	0.0%

Mean	127.3597301
Minimum	0
Maximum	1067
Zeros	51952
Zeros (%)	25.5%
Memory size	1.6 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	165
95-th percentile	664
Maximum	1067
Range	1067
Interquartile range (IQR)	165

Descriptive statistics

Standard deviation	217.6020009
Coefficient of variation (CV)	1.708562045
Kurtosis	2.623684614
Mean	127.3597301
Median Absolute Deviation (MAD)	0
Skewness	1.882608122
Sum	12854927
Variance	47350.63079
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	51952	25.5%
2	401	0.2%
3	375	0.2%
5	349	0.2%
4	346	0.2%
1	344	0.2%
6	323	0.2%
11	313	0.2%
8	291	0.1%
9	291	0.1%
Other values (980)	45949	22.5%
(Missing)	103039	50.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	51952	25.5%
1	344	0.2%
2	401	0.2%
3	375	0.2%
4	346	0.2%

Value	Count	Frequency (%)
1067	1	< 0.1%
1056	1	< 0.1%
1024	1	< 0.1%
1020	2	< 0.1%
1009	1	< 0.1%

pct_possible
Categorical

HIGH CARDINALITY
MISSING

Distinct	102
Distinct (%)	0.1%
Missing	103039
Missing (%)	50.5%
Memory size	1.6 MiB

--	51952
100 %	1271
8 %	976
10 %	966
9 %	946
Other values (97)	44823

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
--	51952	25.5%
100 %	1271	0.6%
8 %	976	0.5%
10 %	966	0.5%
9 %	946	0.5%
11 %	941	0.5%
5 %	937	0.5%
13 %	924	0.5%
7 %	880	0.4%
17 %	870	0.4%
Other values (92)	40271	19.7%
(Missing)	103039	50.5%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	5
Median length	3
Mean length	2.958469994
Min length	2

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	dt	temp	dew_pt	rH	heat_idx	wind_chill	wind_dir	wind_spd	snow_depth	snowfall_3hr	snowfall_6hr	snowfall_24hr	site	file_name	year	sea_lvl_press	sta_press	altimeter_setting	solar_radiation	pct_possible
0	2022-12-23 04:00:00	-25.0	-31.0	72.0	NaN	NaN	ESE	1G4	12.6	0.1	0.1	0.3	JVEMT	JVEMT-2022.html	2022	NaN	NaN	NaN	NaN	NaN
1	2022-12-23 03:00:00	-26.0	-32.0	72.0	NaN	NaN	ESE	1G3	12.6	0.1	0.1	0.4	JVEMT	JVEMT-2022.html	2022	NaN	NaN	NaN	NaN	NaN
2	2022-12-23 02:00:00	-27.0	-33.0	71.0	NaN	NaN	ESE	1G4	12.5	0.1	0.0	0.3	JVEMT	JVEMT-2022.html	2022	NaN	NaN	NaN	NaN	NaN
3	2022-12-23 01:00:00	-28.0	-34.0	72.0	NaN	NaN	ESE	2G5	12.5	0.0	0.0	0.2	JVEMT	JVEMT-2022.html	2022	NaN	NaN	NaN	NaN	NaN
4	2022-12-23 00:00:00	-29.0	-35.0	71.0	NaN	NaN	ESE	2G4	12.5	0.0	0.0	0.2	JVEMT	JVEMT-2022.html	2022	NaN	NaN	NaN	NaN	NaN
5	2022-12-22 23:00:00	-28.0	-34.0	71.0	NaN	NaN	E	2G5	12.4	0.0	0.0	0.0	JVEMT	JVEMT-2022.html	2022	NaN	NaN	NaN	NaN	NaN
6	2022-12-22 22:00:00	-28.0	-34.0	71.0	NaN	NaN	ESE	2G5	12.5	0.0	0.0	0.2	JVEMT	JVEMT-2022.html	2022	NaN	NaN	NaN	NaN	NaN
7	2022-12-22 21:00:00	-28.0	-34.0	72.0	NaN	NaN	ESE	2G4	12.5	0.0	0.1	0.0	JVEMT	JVEMT-2022.html	2022	NaN	NaN	NaN	NaN	NaN
8	2022-12-22 20:00:00	-27.0	-33.0	73.0	NaN	NaN	ESE	2G4	12.6	0.1	0.5	0.2	JVEMT	JVEMT-2022.html	2022	NaN	NaN	NaN	NaN	NaN
9	2022-12-22 19:00:00	-26.0	-32.0	73.0	NaN	NaN	SE	1G5	12.5	0.0	0.7	0.1	JVEMT	JVEMT-2022.html	2022	NaN	NaN	NaN	NaN	NaN

Last rows

	dt	temp	dew_pt	rH	heat_idx	wind_chill	wind_dir	wind_spd	hr_precip	snow_depth	snowfall_3hr	snowfall_6hr	snowfall_24hr	site	file_name	year	sea_lvl_press	sta_press	altimeter_setting	solar_radiation	pct_possible
203963	2022-01-01 09:00:00	0.0	NaN	NaN	NaN	-22.0	S	20G38	NaN	38.1	0.0	0.0	NaN	MRPMT	MRPMT-2022.html	2022	NaN	24.62	29.85	NaN	NaN
203964	2022-01-01 08:00:00	-1.0	NaN	NaN	NaN	-24.0	S	21G37	NaN	38.3	0.0	0.0	NaN	MRPMT	MRPMT-2022.html	2022	NaN	24.60	29.83	NaN	NaN
203965	2022-01-01 07:00:00	-1.0	NaN	NaN	NaN	-24.0	S	21G34	NaN	39.2	0.0	0.0	NaN	MRPMT	MRPMT-2022.html	2022	NaN	24.60	29.83	NaN	NaN
203966	2022-01-01 06:00:00	-1.0	NaN	NaN	NaN	-24.0	S	22G33	NaN	38.8	0.0	0.0	NaN	MRPMT	MRPMT-2022.html	2022	NaN	24.60	29.82	NaN	NaN
203967	2022-01-01 05:00:00	-1.0	NaN	NaN	NaN	-25.0	SSE	24G35	NaN	39.7	0.0	0.0	NaN	MRPMT	MRPMT-2022.html	2022	NaN	24.59	29.81	NaN	NaN
203968	2022-01-01 04:00:00	-4.0	NaN	NaN	NaN	-26.0	S	18G31	NaN	40.8	0.1	0.0	NaN	MRPMT	MRPMT-2022.html	2022	NaN	24.60	29.82	NaN	NaN
203969	2022-01-01 03:00:00	-5.0	NaN	NaN	NaN	-26.0	S	15G21	NaN	41.5	0.5	0.3	NaN	MRPMT	MRPMT-2022.html	2022	NaN	24.59	29.81	NaN	NaN
203970	2022-01-01 02:00:00	-3.0	NaN	NaN	NaN	-23.0	SSW	15G25	NaN	40.9	0.0	0.4	NaN	MRPMT	MRPMT-2022.html	2022	NaN	24.59	29.81	NaN	NaN
203971	2022-01-01 01:00:00	-4.0	NaN	NaN	NaN	-22.0	SW	12G19	NaN	40.7	0.0	1.0	NaN	MRPMT	MRPMT-2022.html	2022	NaN	24.57	29.79	NaN	NaN
203972	2022-01-01 00:00:00	-7.0	NaN	NaN	NaN	-26.0	SSW	12G20	NaN	41.0	0.0	2.0	NaN	MRPMT	MRPMT-2022.html	2022	NaN	24.57	29.79	NaN	NaN

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows